ZstGAN: An adversarial approach for Unsupervised Zero-Shot Image-to-image Translation
نویسندگان
چکیده
Image-to-image translation models have shown remarkable ability on transferring images among different domains. Most of existing work follows the setting that source domain and target keep same at training inference phases, which cannot be generalized to scenarios for translating an image from unseen another domain. In this work, we propose Unsupervised Zero-Shot Translation (UZSIT) problem, aims learn a model can translate samples domains are not observed during training. Accordingly, framework called ZstGAN: By introducing adversarial scheme, ZstGAN learns each with domain-specific feature distribution is semantically consistent vision attribute modalities. Then domain-invariant features disentangled shared encoder generation. We carry out extensive experiments CUB FLO datasets, results demonstrate effectiveness proposed method UZSIT task. Moreover, shows significant accuracy improvements over state-of-the-art zero-shot learning methods FLO.
منابع مشابه
Unsupervised Image-to-Image Translation with Generative Adversarial Networks
It’s useful to automatically transform an image from its original form to some synthetic form (style, partial contents, etc.), while keeping the original structure or semantics. We define this requirement as the ”image-to-image translation” problem, and propose a general approach to achieve it, based on deep convolutional and conditional generative adversarial networks (GANs), which has gained ...
متن کاملUnsupervised Image-to-Image Translation Networks
Unsupervised image-to-image translation aims at learning a joint distribution of images in different domains by using images from the marginal distributions in individual domains. Since there exists an infinite set of joint distributions that can arrive the given marginal distributions, one could infer nothing about the joint distribution from the marginal distributions without additional assum...
متن کاملIn2I : Unsupervised Multi-Image-to-Image Translation Using Generative Adversarial Networks
In unsupervised image-to-image translation, the goal is to learn the mapping between an input image and an output image using a set of unpaired training images. In this paper, we propose an extension of the unsupervised image-toimage translation problem to multiple input setting. Given a set of paired images from multiple modalities, a transformation is learned to translate the input into a spe...
متن کاملZero-Shot Sketch-Image Hashing
Recent studies show that large-scale sketch-based image retrieval (SBIR) can be efficiently tackled by cross-modal binary representation learning methods, where Hamming distance matching significantly speeds up the process of similarity search. Providing training and test data subjected to a fixed set of pre-defined categories, the cutting-edge SBIR and cross-modal hashing works obtain acceptab...
متن کاملUnsupervised Image Translation
An interesting and potentially useful vision/graphics task is to render an input image in an enhanced form or also in an unusual style; for example with increased sharpness or with some artistic qualities. In previous work [10, 5], researchers showed that by estimating the mapping from an input image to a registered (aligned) image of the same scene in a different style or resolution, the mappi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2021
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2021.07.037